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METHOD AND DEVICE OF IMAGE TRANSFORM 



BACKGROUND OF THE INVENTION 
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1. Field of the Invention 



The present invention relates to a method and device of image 
transform used to transform an input image to an output image having a 
large number of picture elements. 
2. Description of the Related Art 



enlarge image data for printing or displaying. Ordinarily, interpolation 
processing has been performed for image transform. In this interpolation 
processing, a new picture element is added between picture elements 
neighboring each other and the value of picture elements to be added is set 

15 to an averaged value of picture element values of picture elements 
surrounding the picture element to be added. However, the image quality 
obtained by this interpolation processing is inferior in terms of clarity. 

On the other hand, a method of performing image transform with 
higher accuracy has been also reported (M.F. Barnsley: "Fractal Image 

20 Compression", AK Peters Ltd.). This report has described a technology 
concerning a method of compressing image data on the basis of Fractal self- 
similarity theory. Though mention has been made of the data compression 
method to be used for data storage or transfer in this report, this technology 
can be also applied directly to image transform processing. Such 

25 applications are described below. 

As a first step, an input image consisting of M X N (1< M, N) 
picture elements (one picture element having k [1 < k] bit tone) is divided to 
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Image transform processing has been performed, for example, to 
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a square block (hereinafter referred to as "domain block") having i X i (1< i 
< M, N) picture elements. Then, a tetragonal block (referred to as "range 
block") of j X j (i < j) picture elements is defined or set for each domain 
block. Every time this range block is set in the input image, an image within 
this block is captured and the range block having the image presenting the 
highest self-similarity to images within the domain block is searched. The 
self-similarity refers to the similarity between a reduced image of the range 
block obtained by reducing the range block image to a size of the domain 
block and the image of the domain block, and the similarity is measured by 
specified standards. By searching the range block image having a high 
similarity to each domain block image in the input image and by replacing 
all the domain block images with the range block image, an image 
magnified by j/i times can be obtained. 

If the domain block image is replaced with the range block image by 
Fractal transform processing, image transform with high faithfulness 
(resolution) is performed within each range block image. However, because 
each range block image is extracted from any region within the input image, 
there is no image continuity in the boundaries of each range block. For this 
reason, the sequential replacement of all the domain block images with the 
range block images causes image continuity to be lacked in the boundaries 
of each range block, presenting a problem in image quality in the boundary 
region. 

SUMMARY OF THE INVENTION 
The present invention has been made to solve these problems 
described above and has contained the following constitution of the 
invention. 
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The present invention provides a method of image transform 
characterized by transforming an original image to an interpolation 
transformed image magnified up to a predetermined magnification during 
interpolation processing of values of each picture element, by performing 
Fractal processing of the original image and transforming it to a Fractal 
transformed image magnified up to the predetermined magnification and 
having the similarity and, further by creating an enlarged image using 
picture element values used for enlargement of images obtained by 
performing an operation for correction of picture element values of both 
corresponding picture elements of the interpolation transformed image and 
the Fractal transformed image . 

In the operation for the correction described above, the weighted 
difference in picture element values between both corresponding picture 
elements of said two images is added to picture element values of either of 
the interpolation transformed image or Fractal transformed image to 
calculate the picture element values to be used for enlargement of images. 

In the Fractal processing described above, the original image is 
divided into two or more domain blocks, two or more range block images 
having the similarity to the image of each domain block are selected, 
averaged values of corresponding picture element values of each range block 
image are calculated and the Fractal transformed image is then created 
from the range block image having the averaged value. 

Also, in the Fractal processing, though the original image is divided 
into two or more domain blocks and the range block image having the 
highest similarity to images of each domain block is selected, if the degree of 
similarity of the range block image is lower than a set threshold, the picture 
element value of the range block image can be replaced, without the 
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operation for the correction, with the corresponding picture element values 
of the interpolation transformed image. 

Moreover, the original image is a color image resolved by each color 
component in specified color space. 

According to further aspect of the present invention, a method of 
image transform is provided which is characterized by performing 
interpolation processing of picture element values of the original image and 
transforming it to an interpolation transformed image magnified up to a 
predetermined magnification, by performing Fractal processing and by 
transforming the original image to the Fractal transformed image 
magnified up to the predetermined magnification and having the similarity, 
and if the difference in picture element values between both corresponding 
picture elements of the interpolation transformed image and the Fractal 
transformed image is larger than a set threshold, the value of picture 
elements of the Fractal transformed image is replaced with picture element 
values of the corresponding picture element of interpolation transformed 
image. 

According to further aspect of the present invention, a device of 
image transform is provided comprising an interpolation processing section 
which performs interpolation processing of picture element values of each 
picture element and transforms an original image to an interpolation 
transformed image magnified up to a predetermined magnification, Fractal 
transform processing section which performs Fractal processing and 
transforms the original image to a Fractal transformed image magnified up 
to the predetermined magnification and having the similarity and a Fractal 
filter processing section which performs an operation for correction of 
picture element values of both corresponding picture elements of the 
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interpolation transformed image and the Fractal transformed image and 
outputs picture element values for enlargement of the image. 

The Fractal filter processing section calculates picture element 
values used for the enlargement of images by weighting the difference in 
5 picture element values between both corresponding picture elements of the 
images and by adding the weighted difference to the picture element values 
of either of said interpolation transformed image and the Fractal 
transformed image. 

fj 10 BRIEF DESCRIPTION OF THE DRAWINGS 

UJ The features of the invention will become apparent from the following 

detailed description of the preferred embodiments when taken in 
fU conjunction with the drawings in which: 

s FIG. 1 is a block diagram illustrating an image transform device 

yl 15 described in Embodiment 1. 

FIG. 2 is an explanatory drawing of Fractal transform operations. 

FIG. 3 is an explanatory drawing of operations in interpolation 
processing. 

FIG. 4 is an explanatory drawing of weighting coefficient. 
20 FIG. 5 is an operational flowchart of a whole device described in 

Embodiment 1. 

FIG. 6 is a block diagram illustrating the image transform device 
described in Embodiment 2. 

FIG. 7 is an operational flowchart of a device described in 
25 Embodiment 2. 

FIG. 8 is a block diagram showing a Fractal transform processing 
section of an image transform device described in Embodiment 3. 
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FIG. 9 is an operational flowchart of a device described in 
Embodiment 3. 

DETAILED DESCRIPTION OF THE INVENTION AND PREFERRED 
5 EMBODIMENTS 

The best mode of carrying out the present invention will be 
described hereafter using various embodiments. 

According to the present invention, as a first step, while linear 
3 10 interpolation processing of picture element values is performed, an input 

: : : 

li image is magnified up to a desired magnification and then the interpolation 

r 

transformed image is obtained. 
"jE On the other hand, the input image is divided into two or more 

jL domain blocks having a predetermined size. Also, a range block image of 

;7 15 high similarity to the domain block image based on Fractal self-similarity 
^ theory is searched. The size of the range block is set to the size of a domain 

v3 block magnified by said transform magnification. Then, by replacing each 

domain block image in the input image with the range block image having 
high similarity to the domain block image, a Fractal transformed image is 
20 obtained. 

After the creation of both the interpolation transformed image and 
the Fractal transformed image each having the same size, the interpolation 
transformed image and Fractal transformed image are processed by a 
Fractal filter processing section. 
25 That is, the Fractal filter processing section outputs enlarged image 

data having high faithfulness and image quality by assuring the continuity 
of the whole image via operations of picture element values of the 



interpolation transformed image and Fractal transformed image and by 
ensuring the faithfulness in detailed regions of an image. 

Embodiments of the present invention will be described in details 
below with reference to the accompanying drawings. 

Embodiment 1 

FIG. 1 is a block diagram illustrating an image transform device 
described in Embodiment 1. The image transform device is comprised of an 
image buffer 1, Fractal transform processing section 2, interpolation 
processing section 3 and Fractal filter processing section 4. The 
interpolation processing section 3 generates and outputs an interpolation 
transformed image. The Fractal transform processing section 2 generates 
and outputs a Fractal transformed image. 

Signal lines (not shown) are connected to the input side of the image 
buffer 1 to receive the input image 10 to be used as an original image. The 
Fractal transform processing section 2 and interpolation processing section 
3 are connected to the output side of the image buffer 1. The output of the 
Fractal transform processing section 2 is connected to a buffer 4-2 and the 
output of the interpolation processing section 3 to a buffer 4-1. The Fractal 
filter processing section 4 outputs picture element values to be used to 
obtain an enlarged output image I (x, y). 

The Fractal transform processing section 2 consists of a domain 
buffer 2-1, range buffer 2-2, reduction processing section 2-3, similarity 
calculating section 2-4 and pointer buffer 2-5. The domain buffer 2-1 and 
range buffer 2-2 are connected to the output of the image buffer 1. The 
output of the domain buffer 2-1 is connected to the input of the similarity 
calculating section 2-4. The output of the range buffer 2-2 is connected to 
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the input of the reduction processing section 2-3 and to the input of the 
buffer 4-2 of the Fractal filter processing section 4. The output of the 
reduction processing section 2-3 is connected to the input of the similarity 
calculating section 2-4. The output of the similarity calculating section 2-4 
5 is connected to the input of the pointer buffer 2-5. 

A control section 5 is comprised of processors and the like to control 
each section of the device including this Fractal transform processing 
section 2. The Fractal filter processing section 4 consists of the buffer 4-1, 
buffer 4-2, subtracter 4-3, weighting table 4-4, multiplier 4-5 and adder 4-6. 

10 The input of the buffer 4-1 is connected to the output of the interpolation 
processing section 3. This buffer 4-1 receives an interpolation transformed 
image outputted from the interpolation processing section 3. The input of 
the buffer 4-2 is connected to the output of the Fractal transform processing 
section 2. The output of the buffer 4-1 is connected to the inputs of the 

15 subtracter 4-3 and the adder 4-6. 

The output of the buffer 4-2 is connected to the input of the 
subtracter 4-3. The output of the subtracter 4-3 is connected to the inputs of 
the weighting table 4-4 and the multiplier 4-5. The output of the weighting 
table 4-4 is also connected to the input side of the multiplier 4-5. The output 

20 of the multiplier 4-5 is connected to the input side of the adder 4-6. The 
adder 4-6 outputs a desired picture element value D described later. 

The operation of the Fractal transform processing section 2 is 
described below. 

FIG. 2 is an explanatory drawing of basic operations of the Fractal 
25 transform processing section. 

FIG. 2(a) shows, as an example, that the input image 10 is an image 
consisting of M X N picture elements. This input image is divided into a 
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plurality of domain blocks 20, each consisting of (i x i) picture elements. In 
the example shown in FIG. 2(a), the input image 10 is divided into domain 
blocks 20, each consisting of 8 picture elements wide and 5 picture elements 
long, being 40 picture elements in total. 
5 It is now presumed that the input image 10 is so transformed that 

picture elements both in vertical and horizontal directions are doubled, 
thereby enlarging the area by 4 times. At this time, the range block 30 (j X 
j) obtained by doubling (2i=j) the picture elements in vertical and horizontal 
directions of this domain block 20 is set in the input image 10. This 

£3 

Iq 10 magnification conforms to that used for enlarging transform. As shown in 

E . S 

i f l FIG. 2(b), images within the range block 30 set in the input image 10 are 

n scanned to find out the range block having an image being similar to that in 

fl 1 

l * the domain block 20. When the range block 30 having an image being 

JL similar to that in the domain block 20 is found, the image in the domain 

f? 15 block 20 shown in FIG. 2(a) is replaced one by one with that in the range 
^ block 30. Thus, as shown in FIG. 2(c), a Fractal transformed image 40 in 

which images selected within the range block 30 are arranged so as to 
correspond to images in the domain block is obtained. 

The input image 10 is latched in the image buffer 1 shown in FIG. 1. 
20 Images in the specified domain block 20 are stored in the domain buffer 2-1 
and images in the range block 30 to be set sequentially are stored in the 
range buffer 2-2. The capacity of each buffer is set to a required level. 

The reduction processing section 2-3 reduces the size of the image by 
one-second both in the vertical and horizontal directions so that the range 
25 block image in the range buffer 2-2 has the same size as the domain block 
image in the domain buffer 2-1. The similarity between the reduced range 
block image and the domain block image in the domain buffer 2 is compared 
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and calculated by the similarity calculating section 2-4. The similarity 
calculating section 2-4 contains a buffer which renews the similarity 
previously obtained every time the maximum degree of the similarity is 
achieved. When the similarity is renewed by the buffer, coordinate values of 
5 a start point of the corresponding range block image are written in the 
pointer buffer 2-5. This means that coordinate values of the start point in 
the pointer buffer 2-5 is renewed one after another. 

When the Fractal processing for one domain block 20 is completed 
by the Fractal transform processing section 2, the control section 5 judges 
^ 10 that the image of the range block 30 designated by coordinate values of the 
start point finally remained in the pointer buffer 2-5 is the most similar to 
Q the image of the domain block 20. The control section 5 reads the range 

FU block image out of the image buffer 1 and stores it into the range buffer 2-2, 

s causing it to be transferred to the buffer 4-2 of the Fractal filter processing 

J ; 

[11 15 section 4. 

»■""" 

* f & The interpolation processing section 3 has a function to perform 

3 interpolation processing of 4-neighbors of picture elements in the input 

image. 

FIG. 3 is an explanatory drawing of operations of the interpolation 
20 processing section 3. The interpolation processing section 3, as shown in 
FIG. 3 for example, set any number of picture elements required for 
enlarging transform of an image among 4-neighbors picture elements and 
calculate their picture element values. This calculation method has been 
already known and one of it has been given here just as an example. 
25 Referring to FIG. 3, the picture element values and positional 

coordinates of the 4 picture elements are set as P 1 (U=0, V=0), P 2 (U=l, V=0), 
P 3 (U=l, V=l) and P 4 (U=0, V=l) respectively. In this example, the picture 
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element value X (U, V) of a point standing at an intermediate position can 
be obtained by the following formula. 

P(l) = (1-U) P x + UP 2 ••••(!) 
P(2) = (1-U)P 4 + UP 3 • • • • (2) 

5 X = (l-V)P(l) + VP(2) • • • • (3) 

The picture element value of each picture element standing between the 2 
picture elements is calculated on the presumption that linear transform 
from one to the other direction is performed. The interpolation transformed 
image is created by performing such calculation of picture element values of 

10 all picture elements of the input image 10 and the result is stored in the 
buffer 4-1 of the Fractal filter processing section 4. 

The Fractal filter processing section 4, by using the following 
formula (4), performs operations of each picture element value of the 
interpolation transformed image and the image of the range block 30. 

15 D(x,y) = Dh(x,y) + w(x,y) X (Df(x,y))-Dh(x,y)) • • • • (4) 

By the term of "Df(x,y) — Dh (x,y)" in this formula, the difference in picture 
element values between the picture elements existing in the coordinates (x, 
y) in the image Df of the range block 30 and the picture elements existing in 
the coordinates (x,y) in the interpolation transformed image Dh is 

20 calculated using the subtracter 4-3. 

The interpolation transformed image is obtained by interpolation of 
picture element values through linear interpolation processing. In the 
operation for the interpolation, a picture element value of a new picture 
element among picture elements is searched on the presumption that no 

25 rapid change in picture element values of neighboring picture elements 
occurs. Therefore, when the input image is handled as analog image data 
and Fourier transform is performed on the image data, the corresponding 
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image regions in the input image is reproduced faithfully in the form of low 
frequency components. 

On the other hand, the image of the range block 30 is an image 
obtained by precise reproduction of the domain block image in the input 
image and, when Fourier transform is performed, it contains components of 
low frequency and high frequency. Accordingly, to perform analog signal 
processing on the input image, with low frequency components of the image 
of the range block 30 subtracted by operations of the term "(Df(x,y) _ 
Dh(x,y))", only high frequency components are extracted as the difference in 
the picture element value. 

In the term of "w(x,y) X (Df(x,y) - Dh(x,y)), the product of the 
difference (high frequency components) in the picture element value and 
weighting coefficient w (x,y) within the weighting table 4-4 is obtained using 
the multiplier 4-5. 

Moreover, as given in the formula (4), the picture element value D 
(x,y) of the enlarged image is calculated by obtaining the product of the 
difference in the picture element value and the weighting coefficient w (x,y) 
and then by adding this product to the picture element value Dh (x,y) of the 
interpolation transformed image using the adder 4-6. 

FIG. 4 is an explanatory drawing of weighting coefficient. 

As shown in FIG. 4, if the density represented as the difference in 
the picture element value is 80/256 and more, the weighting coefficient w is 
set to "0" and if the density is in the range of 20/256 ~ 50/256, the coefficient 
is set to "1". Furthermore, if the density is within the range of 0/256 ~ 
20/256 and 50/256 ~ 256/256, the weighting coefficient is changed linearly in 
the range of 0 ~ 1. Also, for example, if the picture element value is used to 
display black-and-white image, the density of 0/256 and 256/256 is for white 
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and black images respectively. 

The operations of the device of the present invention is described 
using a flow-chart below. 

FIG. 5 is an operational flowchart of a whole device described in 
5 Embodiment 1. The description is here made on the presumption that the 
input image is a mono chrome image and that j / i = 2. 

Step 1: The control section 5 divides an input image having M X N 
picture elements into a domain block having i X i picture elements. 

Step 2; The interpolation processing section, by a linear 
3 10 interpolation of 4-neighbors picture elements, enlarges the input image 
i2 with M X N picture elements, which has doubled picture elements both in 

the vertical and horizontal directions, thus quadrupled numbers of the 
'5 picture elements. 

L. Step 3: The control section 5 initializes the domain block number h 

^ 15 having i X i picture elements. 

H; Step 4: The Fractal transform processing section 2 searches the 

sO range block image having the highest self-similarity to the image of the 

domain block h. That is, a averaged value of each picture element value of 2 
X 2 picture elements for each candidate of the range block is obtained and 
20 the reduction is made using this averaged value as one picture element and 
then a averaged value of squared error in picture elements between the 
image reduced by one-second and the domain block image is obtained. A 
range block having the smallest (largest in terms of self-similarity) value 
obtained above is judged to be the range block used to be replaced with the 
25 domain block h. 

Step 5: The Fractal filter processing section 4 performs filtering by 
operations of the above formula (4). 
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Step 6: The control section 5 increments the domain block number h. 

Step 7: The control section 5, if there are unprocessed domain blocks 
left, continues processing after the return to Step 4. If they are not left, all 
the processing is terminated. 

The Fractal filter processing section 4 sequentially stores the 
enlarged image consisting of the picture element value D (x,y) into the 
buffer 6 for enlargement of the image shown in FIG. 1. Thus, an enlarged 
image I (x,y) is obtained. 

As described above, because the composite image consisting of an 
image portion having a faithfully reproduced interpolation transformed 
image and a high-resolution image portion having a faithfully reproduced 
Fractal transformed image is obtained, an enlarged image of high quality 
can be created accordingly. 

In Embodiment 1 described above, though the picture element value 
D of an enlarged image is obtained on the basis of a picture element value 
Dh of the interpolation transformed image, as shown in Formula (5) below, 
the picture element value D may be also obtained on the basis of a picture 
element value Df of the Fractal transformed image. 

D(x,y) - Df(x,y) +W (x,y) X (Df(x,y) - Dh(x,y)) • • • • (5) 

Also, the same effect can be achieved by obtaining a difference in 
picture element values contained in the interpolation transformed image 
and the Fractal transformed image and then selecting the picture element 
value contained in the interpolation transformed image if the difference in 
the picture element value is remarkable and selecting the picture element 
value contained in the Fractal transformed image if the difference is not 
remarkable . Therefore, the same processing can be also performed by using 
a selector circuit wherein the difference in the picture element value 
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between the interpolation transformed image and the Fractal transformed 
image is compared with a set threshold and either of the picture element 
value is selected by the comparison and outputted. However, as described 
above, the image quality is more improved by weighting processing. 
5 Because the result varies depending on types of an image, it is better to 
determine the weighting coefficient so that the results from repeated 
experiment can be reflected thereto. 

Moreover, the same effect can be achieved by obtaining the degree of 
similarity in each picture element between the domain block and range 

10 block and by comparing it with a predetermined threshold for processing. If 
the degree of similarity is less than this threshold, because it means that 
the difference in the picture element value between the domain block and 
the range block is remarkable, the operation of each picture element value 
contained in the interpolation transformed image and the Fractal 

15 transformed image is omitted and the corresponding picture element value 
of the interpolation transformed image is selected. Because, in this case, the 
processing by the Fractal filter processing section is allowed to be omitted, 
the processing is speeded up as a whole. 

20 Embodiment 2 

The embodiment using a color image as an input image is hereafter 
described. 

According to this Embodiment 2 of the present invention, an 
enlarged image having high image quality and excellent resolution, if a 
25 color image in particular is used as an input image, is obtained. 
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FIG. 6 is a block diagram illustrating the image transform device 
described in Embodiment 2. 

In the device shown in FIG. 6, a color space transform section 7 used 
to perform a preliminary processing for the input image 10 is added to the 
5 device shown in Embodiment 1. This color space transform section 7 is used 
to perform transform processing of color space from (R, G and B) color space 
to CIE's (International Commission on Illumination) standard color space L, 
a and b. By performing such color space transform, it becomes possible to 
change an input image to an image with color space more perceptible by a 

10 human being represented by color component signals and to improve the 
image quality of an enlarged image outputted from the Fractal filter 
processing section 4. This color space transform exerts an influence on the 
picture element values of a new picture element obtained by the 
interpolation processing. It is because, if color space is different, a picture 

15 element value of the interpolated picture becomes subtly different 
accordingly. In addition, in some cases, it may influence results from the 
Fractal transform processing. Though there is color space represented by 
color components other than described above, the color image having best 
transformed color space obtained on the basis of the quality of an image and 

20 results from an experiment should be used as an input image. 

Because operations for processing an input image following the color 
space transform are the same as in Embodiment 1, double description is 
omitted. Due to a color image, processing is performed for each color 
component, i.e., if the transform is for (L, a, b) color space, processing is 

25 performed three times accordingly. 

FIG. 7 is an operational flowchart of a device described in 
Embodiment 2. 
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In this flowchart, processing shown as Step SI, Step S4, Step 10 and 
Step 11 is added to steps in the flowchart in FIG. 5. The contents of each 
processing with the same expression are the same as in the flowchart in FIG. 
5, however, the step number has been changed somewhat due to the 
5 addition of the steps. Step SI is transform processing of color space. Step 4 
and 11 are used to control repeated processing of sequential execution for 3 
pieces of color planes. P is a parameter for repeated processing and its 
maximum value is 3. Step 10 is used to increment this parameter P. 

According to Embodiment 2 of the present invention, by using an 
10 image resolved for each color component in color space being more 
perceptible by a human and having picture elements transformed to those 
being more perceptible by a human in color space as an input image, an 
enlarged color image of higher quality can be obtained. 

15 Embodiment 3 

In Embodiment 1, by detecting a range block image having the 
highest similarity to a domain block image, a Fractal transformed image is 
obtained. There may be, however, cases where the similarity of the range 
block image to the domain block image is low. In this Embodiment, two or 

20 more range blocks, as candidate blocks, having images being relatively 
higher to one domain block image are introduced. Then, by averaging 
picture element value of two or more range blocks being relatively higher to 
the domain block image, a range block image is created. As two or more 
candidate range blocks, for example, 2 ~ 8 range block images having high 

25 similarity can be selected. By using averaged value of picture element value 
of each block, a range block image containing no partially abnormal values 
can be obtained. 
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FIG. 8 is a block diagram showing a Fractal transform processing 
section of an image transform device described in Embodiment 3. 

As shown in FIG. 8, the Fractal transform processing section 2, in 
addition to components shown in FIG. 1, includes a selector 2-6, First buffer 
2-7, Second buffer 2-8, adder 2-9, divider 2-10 and divisor register 2-11. 

Circuit blocks other than described above have the same functions 
as in FIG. 1. In the example as shown in FIG. 8, two candidate range block 
images are used and their picture element values are averaged. The pointer 
buffer 2-5 holds coordinate values of each start point of a range block with 
an image having the most highest similarity and of a range block with an 
image having the second highest similarity. When the candidates for two 
range block images are determined, their images are held in the First buffer 
2-7 and Second buffer 2-8. The selector 2-6 is a circuit used to designate in 
which buffer the range block image should be stored. 

Each picture element is fetched from areas of the First buffer 2-7 
and the Second buffer 2-8 which correspond to each range block and is fed to 
the adder 2-9 for addition. Then, the result is given to the divider 2-10. The 
divider is adapted so that a divisor L (here L = 2) is inputted and the 
division result is outputted. By this, averaged value of two picture element 
value is obtained. By performing processing on all picture elements in two 
range block, a range block image having high similarity can be created. 

FIG. 9 is an operational flowchart of a device described in 
Embodiment 3. The processing steps in Embodiment 3 are as follows. 

Step 1: The control section 5 divides an input image into domain 

blocks. 

Step 2: The interpolation processing section creates an interpolation 
transformed image from an input image by linear interpolation. 
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Step 3: The control section 5 initializes the domain block number h. 

Step 4: The Fractal transform processing section 2 detects two range 
block images having self-similarity to the domain block h. By using the 
processing described above, a range block image created by averaged value 
of picture element value is obtained. 

Step 5: The Fractal filter processing section 4 performs operations of 
the above Formula (4) or (5) and filtering. 

Step 6: The control section 5 is used to increment the domain block 
number h. 

Step 7: The control section 5, if there are unprocessed domain blocks 
left, continues processing after the return to Step 4. If they are not left, all 
the processing is terminated. The total number of the domain blocks are set 
to K. 

According to Embodiment 3 of the present invention, by selecting 
two or more range blocks having relatively high similarity to the domain 
block image in the input image and by replacing the range block image in 
which picture elements have averaged values of picture element value of the 
range block image with the domain block image, even if there is no range 
block image having high similarity, an enlarged image of high quality can be 
obtained accordingly. 



